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Abstract 

We show in this paper that in constructing a theory for the most 
elementary class of control problems defined on spheres, some results 
from Lie theory play a natural role. In particular to understand con- 
trollability, optimal control, and certain properties of stochastic 
equations. Lie theoretic ideas are needed. The framework considered 
here is probably the most natural departure from the usual linear system/ 
vector space problems which have dominated the control systems literature 
For this reason our results are compared with those previously available 
for the finite dimensional vector space case. 
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1, Introduction 

Specific results about control systems whose state spaces are 
spheres have been. useful in understanding problems in energy conversion, 
controlled rigid body dynamics, etc. Some examples are mentioned In 
our earlier paper [1]. Here we work out in more detail, and in greater 
generality, the theory for a class of problems of this type and compare 
out results with the case where the state space is a vector space. To 
carry out this program requires some results from Lie theory. Lie groups 
acting on spheres, etc. There has been no attempt here to discuss the 
most general setting in which techniques which we -use are applicable. 

Instead we have taken the sphere problems as a model and have studied a range 
of control- theoretic questions in that setting. A number of possible 
generalizations will be apparent. 

To begin with we mention some well known facts about linear system 
theory. We do this to make the paper a little more accessible to those 
not familiar with control problems and to sensitize the reader to certain 
Issues important in control. For a more complete, account and references 
to the literature one can consult [2] for the deterministic results and 
(3) for the stochastic results. 

Linear system theory deals with the pair of equations 

x(t) « Ax(t) + Bu(t) ; y(t) « Cx(t) (1.1) 

where x denotes a time derivative. It is assumed that x(t) £ n(t) C 

and y(t) £"7?^^, For simplicity we take A,B,C to be constant matrices. 

One calls u the control , x the state and y the output . The theory of linear 
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system fs- extensive but for our present purposes we point but only . 
the following five results. ' 

IX (l*i) is said to be controllab le if for every x^ and in Tff” 
and every > 0 there exists a piecewise continuous control u(*) such 
that if x.(0) » then x(t^) » x^. A necessary and sufficient condition 
for controllability is that Rank(B,AIi, . . .a'^ ® n where , indicates a 

column partition. 

iiX (1.1) is said to.be observable if for every x^ ^2 and every 

> 0 the outputs corresponding to and ^2 differ on the interval 

[Ojtj^l.. A necessary and sufficient condition for obser/ability Is that 

rank (CtCA;. ,.C a” n where ; Indicates a roT7 partltlon^ 

• iiiX If (1.1) is controllable then for every given and x^ in 7??^ 

and every^ t^^ > 0 there exists a piecewise continuous control u defined on 

[0,t-I which transfers the state from x at t « 0 to x, at t « t, and 
X o 1 1 

minimizes 

n(t) " f ^ u*(t)u(t)dt (1.2) 

-^0 

rt-.lative to all other piecewise continuous controls which accomplish 
the same transfer. 

Iv) If there exists a linear feedback control law u *» Fx such that 

X - (A+BF)x has a null solution which is asymptotically stable then there exists. a 

control law u.« Kx such that lim x(t) » 0 and the functional 

t-w® 

. n “ f u*(t)u(t) + 7* 'Oy(t)dt 
is minimized by setting u(t) « Kx(t). 


; : 



i 
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v) If (1.1) is controllable and if the differential equation x - Ax ! 

is asymptotically stable then the associated stochastic equation (for 
notation sec [3]). 

dx(t) “ Ax(t)dt + Bdw(t) (1.3) 

has a unique invariant Gaussian measure which has zero mean and variance 
Q satisfying 

QA + A’Q - -BB’ (1.4) ■ j 

In this paper we establish analogs for each of these results for 
systems of the type . • 

m • , . • ■ * i 

x(t) » (A + u (t)B )x(t) ; y(t) - Cx(t) (1,5) I 

i«i ^ • ! 

where . . . ,B^ are skew symmetric. matrices and the system can be 

thought of as evolving on the sphere ||x(t)|| « ||x(0)||. 

One significant point in the linear theory is that the matrix B is 

generally not invertible and cases for which it is invertible are so infrequent 

as to be virtually without interest. If B is invertible then by an 

appropriate choice of basis equation (1.1) becomes i 

x(t) » Ax(t) + u(t) (1.6) j 

and controllability is automatic. Moreover, in this case problems iii) * ‘ j 

and iv) are easily reduced to variational problems of the classical type , 

n - f ^ L(x,x)dt (1.7) 

^0 

with t quadratic in x and x and positive definite. Control theory 
works with the more general "degenerate" case where is only nonnegative 
definite but certain constraints are in effect, -If the above integral is 


thought of as the action Integral in a mechanics problem then the case 
treated: in control theory allows for the possibility of certain zero 
masses provided there are appropriate linear constraints between position 
and velocity. It can also be thought of as a limiting case of an uncon- 
stralnc<{ dynamical problem where certain masses and associated energies go 
to infinity.'-' ITiis second interpretation is generally more useful. Remarks 

of the same type apply to equation (1.3) where existance of a smooth 

trarsltion density is well known if B is invertible whereas the sane is true, 
but for rather more subtle reasons, if we assume controllability instead 
of invertlbllity of B. 
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2 , Controllability 

One of the taaln areas of applicability of Lie theory in control has 
been that of determining the set of points reachable along solution 
curves of x(t) ■ f (x(t) ,u(t) , t) for the set of all piecewise continuous 
controls u(*)* For studies of this kind see references [^-7], If the 
control equations are of the form 

x(t) - (A + u (t)B.)x(t) j x(t) e ’w” (2.1) 

1*1 • 

then the system typically evolves on a manifold ip The determination 

of the set of points reachable from a given point can be accomplished 
by the determination of the sot of matrices reachable from the Identity 

for the matrix equation ‘ . -t:> 

, in 

X(t) - (A+ [ u/t)B.0X(t) ; X(0) * I (2,?.) 

i«l ^ ^ 

and then letting this set act on x^ via ordinary matrix- vector multiplication. 
Equation (2.2) can be thought of as defining a control problem on a matrix 
Lie group. The ci^^stion of determining what matrices are reachable from 
the identity along solutions of (2.2) has been the subject of a number of 
papers [1» 7-10]. Following Jurdjevlc and Sussmann^ we term systems of the 
form of (2...) right invariant . This is appropriate because the vector fields 
defined on the CL(n) by the right side of (2.2) are invariant under the trans-- 
lation defined by right multiplication with an clement of GJt(n). We will say * 
that equation (2,2) is controllable on a group if any two points in 2? cap 
be Joined by a solution curve generated by some piecewise continuous control 

u(*). 


Suppose that A and are all skew symmetric. Then 

regardler.s of the choice of u the solutions of equation (2i^l) remain 
on the sphere defined by | |x(t)|| » llx(0)ll. Wc will say that the 
system (2.1) is controllab le on the sphere if any two points on the sphere 
be Joined by a solution curve generated by some piecewise cont.lnuous 
curve u("). Phrased another way, the system is controllable if the set 
of matrices reachable from the identity along solutions of (2.2) act 
transitively on From earlier results [10] wc know that since the 

motion is confined bo a subgroup of S0(n) the set of matrices reachable 
from I is the matrix Lie group consisting of all the natid.ces which can 
be expressed as products of the form exp exp H 2 »...expH^ where 
belong to the Lie algebra generated by A.B^jB^, , . 

n— 1 

Now of course the orthogonal group S0(n) acts transitively on S 
so that if the algebra generated by A.B^.B^, . . . *B^ is the full set of 
skew symmetric matrices then the system (2.1) is controllable on 
However there are certain subgroups of S0(n) which act transitively on S*' 
as well. The real compact forms of the classical Lie groups arc all 
candidates. The results are well known [11] but we repeat them here. 

For example, it is clear that both the full unitaiy group and the special 
unltsry group of dimension n act transitively on the set of complex n-vectors 
whose Hermetlan length is one. But this set is Just a set of vectors with 
components (x^+»^T y^) such that 

I (Xi + y?)"l (2.3) 

which is a 2n-l dimensional sphere. Thus by defining the realification [12] 
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of the unitary algebras by the Lie algebra homomorphism 


ReB ImB 


[fcoB ReBj 

we obtain a set of real matrices whose associated grojp acts transitively 
2nrl 

on S The real compact form of is the intersection of special 

unitary group and the symplectic groups. Naturally this representation 
is in terns of matrices of even dimension so that they can act on even 
dimensional complex vectors only. Thus, by analogy with the unitary case, the real 
compact form cf acts on the sphere of dimension This action is known 

to be transitive and of course we can add to the algebra real multiples of I . 
to get the *^full quaterion-unitary group" which acts transitively as well. 

These four cases^ each valid for all Integer n, together with three particular 
ones account for all possibilities. The particular cases may be explained 
as follows* The exceptional algebra Gj admits a 7 dimensional skew- 
symmetric representation whose exponential acts transitively on S^. The 
spin representation of S0(7) is 8 dimensional and it acts transitively 
on The spin representation of SO (9) is 16 dimensional and it acts 
transitively on With this explanation we can state the following result. 

Theorem 1: Let be a collection of n by n skew symmetric 

matrices. The control system 

- m ■ * 

i(t)-(A+ I u (t)B )x(c) (2.S) • 

. i-1 ^ ^ 

Is controllable on s” ^ if the algebra generated by A,B, ,B-,. . . ,B is 
i) SO(n) for n “ 0 mod 2 

li) SO(n)'or the realif ication of SU(n/2) or U(n) for n - 1 mod(2) 

Hi) The realif ication of Sp(n/2) for n » 1 mod(4) 
iv) If n « 6, Spin (8) if n. - 7 or Spin (16) if n - 15 . . • " 


Moreover;,, if the Lie algebra is not one of these cases the system (2.8) 
is not controllable. 

If the system is not controllable on s” ^ it is sometimes of interest 
to compute exactly what points can be reached from a given initial state. 

The determination of what points belong to this set is facilitated by 
a knowledge of the structure of the representation defined by the matrices 
in the algebra generated by A,Bj^,B 2 > . . .B^. If this representation is not 
Irreducible then Its reduction is clearly the first step in the determination 
of the reachable set. The properties of the irreducible pieces may reveal 
the form; of the reachable set in a s traightforvrard way. For example, if 
the evolution equation can be decomposed as • * 

[I® A^ + A^® I + I u (I®Bj[- + B^® I)]x(t) (2.6) 

i“l 

then the Kronecker product of the reachable group for 
* - m . 

X(t) - (A^ + I u,(t)Bpx(t) (2.7) 

■ ■ ' . ' i-1 

and the reachable group for 

X(t) - (A^ + I u (t)B;)X(t) (2.8) 

i«l 

contains the reachable group for equation (2.2). The reachable group will 
not^ ih general^ simply be the Kronecker product of the reachable groups unless 
the effects of the u*s are decoupled. 

For the linear evolution equation (1.1) it happens that if it is possible 
to transfer any. state to any other state then this transfer can be done 
in arbitrarily small time. . This is not the case for systems defined by 
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equation {2*1). Jurdjevlc and Sussmann [7] give an example of a system 
2 

defined on S which is controllable but certain transfers cannot be 
made in less than 1 unit of time. Thus if (1.1) is controllable on S*' 
the strongest statement we can make on the basis of the. present analysis 
is that for t^^ sufficiently large every state can be transferred to every 
other state in t^^ units of time. Estimates on this time have not yet been 
worked out. 

In the vector space case controllability is closely related to the 
concept of observability as mentioned in the introduction. In the present 
setting this is not the case at all. We say that the system 

m ' ' ’ ’ 

x(t) » (A + u^(t)S^)x(t) ; y(t) - Cx(t) (2.9) 

is observable on ^ if no two distinct initial states on give rise 

to the same response y for all controls u(.). The following theorem gives 
a necessary and sufficient condition for observability. 

Theorem 2: Let A, ^ collection of skew symmetric 

matrices and let c be a unit vector. Tlie control system 
m 

x(t) -(A+ [ u.(t)B.)xCt) ; y(t) « cx(t) 
i»l ^ ^ 

is observable on ^ If and only if the set of matrices {A,B, . . ,B .cc*} 

12 m* 

are irreducible. 

For a proof of this theorem and more general results of this type 
see [13]. 
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3. Optimal Control 

Consider again the evolution equation (2.2) defined on matrix 
group Let there be given a time t^^ > 0 and boundary conditions 
of the form X(0) ■ ; X(t^^) » X^^, Suppose that in addition there 
is given a functional which is of the action type 


■'t. i-i ^ 


as opposed to the geodesic type 


-Tij “ f ^ ( f 

1..1 ^ 


Our problem is to determine if there exists a control u(«) such that 
the boundary conditions arc met and the given functional is minimized and, 
if cuch a control exists, to characterize It. Jr.st as with controllability, 
there is an obvious connection between problems defined on a group and problems 
defined on a manifold on which that group acts. This would no longer be 
the case if p depend end on x in a general way. 

We will use the formalism of the maximum principle of Pontryagin [14] 
rather than the calculus of variations to attack this problem because it 
handles the degcnerocy which is built into the problem in a natural way. 

Applied to the present problem, Pontryagin *s maximum principle asserts that 
if u(») is an optimizing control then there exists a matrix P such that 


and defined by 


P(t) » -A'P(t) - I 

i“l ^ 


H(P,X,u) » <P,AX> + J u <P,B X> + J 


(3.4) 


-Il- 


ls nlnimlzed with respect to u by the optimal control. Thus we have the 
optimal, control given by - 

c^(t) « <-P(t)^B^X(t)> (3.5) 

This choice of u gives a pair of differential equations with split 
boundary conditions 


A 0 X(t) n 

. + I <P,B,X 

0 i«l ^ 


[PCt) 


The problem can be reduced to a single quadratic equation with split 
boundary conditions by introducing K « XP*. An easy calculation shows 


* ra 

K(t) - AK(t) + K(t)A' - I <B!.K(t)>(B,K(t)+K(t)B!) (3.7) 

1«1 ^ ^ ^ 

So far everything is valid for an arbitrary subgroup of Gi(n). If 
self contragredient then a simplification occurs* 

In that, case any solution of the differential equation for P can be 
expressed’ in terms of a solution of the differential equation for X with 
nonsingular boundary condition^ ie.P(t) « NX(t)M for some constant matrices 
K and N*. Specializing to the skew symmetric case gives the following result. 
Theorem 4; Suppose that A.B^.B^, . . .B^ are skew symmetric n by n matrices 
and suppose that there exists a piecewise continuous control u(0 which 
transfers the state of the matrix system 

X(t) - (A + (3.8) 

from at t. “ 0 to Xj^ .at t • >' 0. .-Then there exists constant 

matrices Hand H such that the solution of 



(3.13) 



which, after all, come from minimizing the action integral on SO (3). 

(Note that the kinetic energy of a rigid body can be expressed by 
the trace fora (det I)tr(I where I is the usual inertia tensor. 

• See [2] page 64. Incidentally, this also serves to define the degree 
of difficulty of actually solving the control problem mentioned above. 
Since it is well known that the solution of the Euler equations generally 
Involves elliptic functions, the solution of the optimal control problems 
cannot be expressed in terms of elementary functions except in special 
cases. 

By far the simplest special case on SO(n) occurs when is the 

negative of the integral of the Killing form. That is given X(0) and 

X(l) and given the evolution equation 

n(n-l)/2 * 

X(t) - I u (t)B X(t) ; X c SO(n) (3.1.,) 

1=1 , ^ 

where and for all i and j ' 

. - tr - 6^^ (3.15) 

one finds that the optimal trajectory is 

X(t) - e^‘x(0) (3.16) 


vhcre is the solution of - X(1)X"^(0) which has the smallest Frobenius 
norm. 

We turn to applying the above results to the problem of 
optimizing trajectories on spheres* Note that trajectories on spheres can be 
optimized for fixed end points by solving an associated right invariant 
group problem and then picking the minimizing element in t.\e group for 
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transf erring x^ to x^. The following ‘theorem expresses this. 

Theorem 5 : Let . . . ,B^ be skew symmetric matrices. Suppose 

that the system 

n 

x(t)»(A+ I u. (t)B )x(t) (3.17) 

i»l ^ ^ 

Is controllable on S^, Then given a sufficiently large time t^^ > 0 and given points 
Xq find x^ in there exists a control ‘.^h.ich transfers the system from 

x^ at t « 0 to x^ at t = and minimizes 

n - [ ^ u* (t)u(t)dt (3.18) 

I 

Moreover, there exists a matrix such that the optimal 

control is given by u^(t) » <K(u),B^> where K is defined by the matrix 

differential equation 

K(t)« [A,K(t)] + I <K(t).B.>[K(t),B ] ; K(0) « (3.19) 

. 1=1 ^ ° 

We complete this section on optimal control with a result of the 

type which plays a major role in linear system theory in connection with 

the regulator problem. 

Theorem 6; Let A and B be n by n skew symmetric matrices and consider 
the system ^ 

x(t) - Ax(t) + u(t)Bx(t) (3.20) 

Ltt a be a unit vector in the null space o.f A such that A and Baa*B* are a 

pair of matrices which act irreducibly on the orthogonal complement of 

the one dimensional subspace defined by a. Then the control law u(t) •» 

a*Bx(t) steers the system from any initial state x -a to a and minimizes 

o 

the integral 





Thus It the control law u(t) « a*Bx(t) actually drives the state x to 
a then It is optimal. However, observing that a’x(t) has a derivative 
along the given solution which is equal to -[a*Bx(t)] , we see by 

LaSalle^s theorem (see e.g. [2]) that the solution x “ a can fail to be 

At 

stable if and only if a* Be x vanishes identically for some x s* ±a. 

By looking at the derivatives at t » 0 we sec that this can happen if 

and only if (Ba,ABa,. . ^Ba) falls to span the orthogonal complement of the one 

dimensional subspace defined by a. 
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4. Stochastic Differential Equations 

We consider now a third aspect of control theory on spheres. 

This has to do with the analog of property (v) mentioned in the intro- 
duction. What we show is that controllability .implies the existance 
of a unique invariant measure for a stochastic equation on We use 

Ito notation for stochastic differential equations. Wong [3] can be 
consulted for an explanation of both the ciaLhcmatics and the notation. 

Let w, ,w*,.,,,v 7 denote independent Wiener (Brownian motion) 
12m 

processes of unity variance. In giving a precise meaning to differential 
“ equations in which something like "white noise" appears K. Ito [16] 
-invented what has proven to be a very -successful calculus^ in which the 
standard differentiation rule is significantly modified insofar as 
differentials of Wiener processes are concerned. In this calculus dw^dw^ 
d^jdt, a first order term; dw^dt, and (dt) are both higher than first 
order. We discuss the implication of this in one important special case. 
If X and y are vectors satisfying the Ito differential equations 

dx(t) “ Ax(t)dt + Bx(t)dw(t) (4.1) 

dy(t) » Fx(t)dt + Gy(t)dw(t) (4.2) 

Then z(t) « x(t)y* (t) satisfies the Ito equation 


. dz(t) - (Az(t)+z(t)F’ + Bz(t)G)dt + (Bz(t)+z(t)G) dw (4.3) 

The only other fact we need about Ito equations concerns the associated 

mean equation. If x and y satisfy eq’iations (4.1) and (4.2) then 

x(t) « ^x(t) and y(t) » £y(t) satisfy the ordinary differential equation 

— (4.4) 

Gt 

y(t) = Fy(t) , ’ 


(4.5) 
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We will see that these two results permit the derivation of equations 
for all moments and imply that the moment equations are decoupled from 
each other. 

Recall that the number of linearly Independent degree p forms in 
n variables is given by 


N(n,p) 


(4.6) 


We can therefore associate with each n tuple . . ,x^) a N(n,p)-tuple 

/p x^’^x^p.-px^) vhere the coefficients are chosen in such a 

way as to validate the equality 

It is clear that If x satisfies an ordinary differential equation which 
is linear, say 


— x(t) « Ax(t) 


Jp] 


then X also satisfies a linear differential equation 


dt 


4 x^P^(t) = A^P^xCt) 


(4.8) 


(4.9) 




We regard this as a definition of It is related to the classical 

idea of an induced representation. Of course if there are controls present 
a similar set of equations follow; i,e, equation (2.1) Implies 


:^'xfP^(t) - Aff'lx[?^(t) + I u.(t)B|PyP^(t) 
dt 1-1 ^ ^ 


(4.10) 


Similar remarks hold for stochastic equations of the type under 
consideration here, provided suitable allowance Is made for the Ito 


calculus. Associated with Ito equation 

m 

dx(t) » Ax(t)dt + I B.x(t)dw 
i-1 ^ 


(4.11) 
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is the family of equations 

dx^^^(t) - ((A- I I +“ (Bj^^)^)x(t)dt+ I Bj^^x(t)dw 

1»1 ^ ^ 2 ^ iol ^ ^ 

(4.12) 

The derivation of this is a straightforward exercise using the properties 
of dw^ outlined above. Finally^ we have the moment equations associated 
with (4.11) 

m 


zM 


(4.13) 


dx^^^(t) - ((A - I -j i (b[^^)^)x 

i“l • ^ 2 i 

where x^^^(t) *» £x^^^(t). O^unpare with reference 17. ^ 

In terms of the Ito calculus when can the matrix stochastic equation 

m 

dX(t) - AX(t.)at + I dw (t)B X(t) (4.14) 

1“1 ^ 

be thought of as evolving the orthogonal group? This will be the case 
when the associated vector equation (4.11) evolves on the sphere defined 
by l|x(t)|l « |]x(0)|| for alt x(0). Using the facts outlined above 

9 

we see that d(x*x) « 0 if anct only if for all 1 


- -B* ; a+|b^ = -(A + -jB^) 


ip2^. 


(4.15) 


. Thus these are the conditions under which equation (4.14) evolves in the 
orthogonal group and the conditions under which (4.11) evolves on the 
sphere. 

It is apparent that the Pleasure eclated with the uniform density 
' on the sphere is an Invariant measure for the process defined by equation 

(4.11). Since the area of the (n-l)-sphere is (n/2) the uniform density 

is • ' ■ . 

' , ' p^(x) " r(tt/2)/2Tr"^2 ■ (4.16) 
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The corresponding values of the odd moments are zero by symmetry but the 
even moments. are not. The following theorem shows that all the moments 
approach the moments associated with a uniform distribution if wa have 
controllability. Incidentally, equation (4.13) provides a means for actually 
computing the moments for all time In terms of their values at t - 0. 

Theorcp 7 : Suppose that are all skew symaetric and suppose that 

ic(t) " (A + \ u.(t)B.)x(t) (A. 17) . 

1«1 ^ ’ 

Is controllable on Then the solution of the Ito differential 

equation defined on the sphere 

dx(t) « (A - I 4 B^)x(t)dt + ^ B x(t)dw (4.18) 

is such that all moments apprea-^.h the moments associated with a uniform 
distribution on the n-1 sphere as t approaches infinity. 

Proof ; First of all, note the shift in notation from (4.11) to (4.18). 

In (4. 11) . A- is playing the role played by A alone here. It is 

not difficult to show that because A,B^,B 2 , . * are skew symmetric it 
follov 7 s that are also skew symmetric. A second 

observation concerns stability. If A “ -A* and B^ ® -B^ then all 
solutions of the ordinary differential equation 

x(t) - (A + j; i Bhx(t) (4.19) 

■ 1-1 

are bounded. Moreover, each solution approaches zero as t approaches 
infinity provided B^e^^x does not vanish identically for any x 0 and 
there will exist nonzero vectors such that B^e^^x vanishes Identically 
if and only if A and B^ can be put in the form 


I 
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To prove the first of these facts we notice that since A » ~A* 


^ - I I|B,x(t)|r 

i“l 


Thus by LaSalle*s theorem (see e.g. [2]) the solution either goes to zero 

or else there is a solution along which ||B^x(t)]| vanishes identically 

for all 1. That solution would have to be of the form e^^x . As for the 

o 

'“conditions on A and’B^, they follow from considering the subspace of 

, vectors such that.B^e^^x vanishes, together with its orthogonal complement, 

making use of the skew symmetry of A,B- i ,B . 

1 m ' 

Clearly controllability implies that all solutions of the mean 
equation approach zero as t approaches infinity because controllable 
systems cannot be decomposed as Indicated. As for the higher moments, 
we must distinguish between the even and odd cases. For the odd cases 
if there^is a decomposition then controllability of the equation (4.17) 
is clearly Impossible. For the even moments, we have in view of 
the identity ||x^^^(|^ « a’ decomposition of the type given by 

equation (4.20) but with the zero block in being one dimensional. 

The one dimensional subspace defines the steady static value of the 
even moments. On the orthogonal complement the equation (4.18) is 
asymptotic illy stable. These remarks are related to some well knovm 
properties of orthogonal representations of Lie algebras. 
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